SUBSOLUTIONS OF TIME-PERIODIC HAMILTON-JACOBI 

EQUATIONS 

DANIEL MASSART 

^^ , Abstract. We prove the existence of C critical subsolutions of the 

(*^ ■ Hamilton-Jacobi equation for a time-periodic Hamiltonian system. We 

04 ' draw a consequence for the Minimal Action functional of the system. 
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The purpose of this note is to generahze to time-periodic Hamiltonian 
systems some results that are known for autonomous (time-free) systems, 
namely Theorems 1.3 and 1.6 of |FS04j . and Theorem 1 of IMt03j . 

We call time-periodic Hamiltonian a C^ function H : T*M x T — > M, 
where M is a closed, connected manifold, and T is the unit circle, such 

C^ ■ that the restriction of H to any subset T*M x {t}, for {x,t) G M x T, 

is strictly convex and superlinear (see |Mr91j which originated this line of 
research). We make the additional assumption that the Hamiltonian flow 
of H is complete. The T factor is understood as a periodic dependance on 

^ \ time, whence the name. The Hamilton-Jacobi equation (HJc) is 

T-H . du ^^. du . 

^^ , where the unknown « is a C function M x T — > M, and c G M is a constant. 

^5 ' In general there may be no solution at all. One possible way around this 

fact is to look for solutions in a weak sense, say, viscosity solutions fsee|F]. 
"^ \ |BeR04j ) . Another is to look for subsolutions, i.e. C^ functions u such that 



o 

s 

> 



du ^^, du . 

- + Hi.,-,t)<c. 

The two approaches turn out to be connected, as shown by |FS04j . 



^ ' Since M x T is compact, any function is a subsolution for a sufficiently 

H , large c, so the set I of c G M such that (HJc) has a subsolution is not empty. 

A subsolution of (HJc) is a subsolution of (HJc'), for any c' > c, so / is an 
interval, unbounded to the right. Due to the convexity and superlinearity 
of H, and to the compactness of M x T, H is bounded below, so / must 
be bounded to the left. Its infimum is called the critical value of H, and 
denoted a{H). 

It is natural to ask whether / is closed, i.e. whether a{H) G /. A sub- 
solution of (HJa(-fr)), if it exists, is called critical. When H is autonomous 
the answer to the latter question is provided by Theorem 1.2 of ( |FS04j : 

Theorem 1 (Fathi-Siconolfi). There exists a C^ critical subsolution. 
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We extend this theorem to the time-periodic case in Section |21 The idea 
of (the first step of) the proof is borrowed from £Ba,, and uses the estimates 
of Section 2.2, which were proved in |Mt03j for the autonomous case. 

The Hamiltonian H being convex and super hnear, we may take advantage 
of the Lagrangian formulation of Classical Mechanics. Define 

L : TM X T — ^ M 

{x,V,t) I > SUPp(,T^M{<P,V> -H{x,p,t)} 

then L is C^, fiberwise strictly convex and superlinear. It defines, via the 
Euler-Lagrange equation, a flow <l>t on TM x T which is complete since it is 
the conjuguate, under Legendre Transform, of the Hamiltonian flow of H. 

Define Aiinv to be the set of <l>i-invariant, compactly supported, Borel 
probability measures on TM x T. Mather showed that the function (called 
action of the Lagrangian on measures) 

Minv > I^ 

is well defined and has a minimum. It turns out that this minimum is 
—a{H). For this reason a{H) is also denoted a{L). A measure achieving 
the minimum is called L-minimizing. 

One drawback of this characterization of the critical value is that when 
you want to test the minimality of a measure, you first need to check invari- 
ance. With this in mind, an important corollary of Theorem 1.3 of |FSn4j 
is Theorem 1.6 of |FSn4j . which is itself an elaboration on a theorem proved 
by Maiie in |Mn96j . and was proved by Bangert f |Ba99j l in the special case 
when the Lagrangian is a Riemannian metric. 

Definition 2. A probability measure fj, on TM is called closed if 



\\v\\ dfi{x,v) < +00, 
/TM 

and for every smooth function f on M , we have 

I df{x).vdij{x,v)=0. 

JtMxT 

Mather proved in |Mr91j that every invariant measure is closed. 
Theorem 3 (Fathi-Siconolfi). We have 

— a(0) = min < / Ldfi: fi is closed > . 
[ Jtm J 

Moreover, every closed measure that achieves the minimum above is invari- 
ant under the Euler-Lagrange flow of L, and is thus a minimizing measure. 

The strength of this theorem is that it allows to work with measures with- 
out having to verify a priori that they are invariant. We give an appropriate 
definition of a closed measure for a time-periodic Hamiltonian system in 
Section 13.11 and indicate how the proof of Theorem |31 carries over to that 
case. 

The critical value is thus a useful tool for selecting interesting invariant 
subsets ; for instance the supports of minimizing measures (Mather set), or 
the Aubry set (see below). The following classical trick gives us more milk 
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from the same cow. If w is a closed one-form on M, then L — to is again 
a convex and superhnear Lagrangian, and it has the same Euler-lagrange 
flow as L. Besides, by Mather's Lemma (invariant measures are closed) if 
fi € M-inv, the integral jj,^^^jOjd^ only depends on the cohomology class 
of u). Then the minimum over Admv of J{L — u)dfi is actually a function of 
the cohomology class of uj, the opposite of which is called the a-function of 
the system. An (L — LL')-minimizing measure is also called {L, a; ) -minimizing 
or (L, c)-minimizing if c is the cohomology of uj. To sum up 

c I — > -mini Jj,j^j^j{L-Lo)dfi: ^i e Mmv M = c| . 

In particular a{L) = aL^O). We shall omit the subscript L when no am- 
biguity is possible. Mather proved that a is convex and superhnear. The 
analogy with the Lagrangian goes no further ; in general a is neither stricly 
convex, nor C^ (see |Mt97) ). The regions where a is not stricly convex (be- 
ing convex, it must then be affine) are called faces of a. By Proposition 6 of 
(see |Ben2j for the time-periodic case) changing the cohomology class 



within a given face does not select any new dynamics. The presence of faces 
is often correlated with some rationality properties of homology classes (see 
|Mt03j . Corollary 3). Understanding this phenomenon is the motivation for 
Theorem 1 of ^Mt03^ . which we extend to the time-periodic case in the last 
section. The proof uses both the estimates of Section 2, and the existence 
of a C^ subsolution, instead of Whitney's Extension Theorem as in |Mt03j . 
Acknowledgements : I thank the referee for his careful reading and 
insightful advice. It is a pleasure to acknowledge the great hospitality of the 
CIMAT in Guanajuato, Mexico while working on this project. 

2. Preliminaries 

2.1. Some Weak KAM theory. In this section we briefly recall a few 
definition, referring the reader to the bibliography (^, and |CISj for the 
time-periodic case) for more information. Define, for all n G N, 

K: (M X T) X (M X T) — > M. 

{{x,t),{y,s)) I — > min//"^"L(7,7,f)dt-hna(0) 

where the minimum is taken over all absolutely continuous curves 
7: [t, s -|- n] — > M such that 7(i) = x and 7(5 + n) = y. Note that we 
abuse notation, denoting by the same t an element of T = M/Z or the 
corresponding point in [0, 1[. The Peierls barrier is then defined as 

h: (M xT) X (M xT) — > R 

{{x,t),{y,s)) I — > liminin^oohniix,t),{y,s)) . 

The Aubry set is 

Ao:={{x,t) gMxT: h{{x,t),{x,t)) = 0} . 

We say a function /: M xT — > M is (L, a(0))-dominated if for every 
absolutely continuous curve 7 : [a, b] — > M with b > a we have 

" (L(7, 7, t) + a(0)) dt>f (7(6), 6)) - / (7(a), a)) . 
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Such functions exist and are Lipschitz (^, Lemma 4.2.2), hence almost 
everywhere differentiable by Rademacher's theorem ; wherever the derivative 
exists, they are subsolutions of the Hamilton- Jacobi equation (see |FS04j 'l. 
that is 

f + i.(x.|{.t)<a(0). 

A forward (resp. backward) weak KAM solution is a function u which is 
(L, a(0))-dominated and, for every (x, t) G M x T, there exists an absolutely 
continuous curve 7: [t, +00] — > M (resp. 7: [— oo,i] — > M such that 
7(i) = X and, for every s G [t, +00] (resp. s € [— oo,t]), we have 

(L(7(t),7(t),t)+a(0))dt = u(7(s),7(s),s)-u(7(t),7(i),0- 

For every forward weak KAM solution m+ there exists a unique backward 
weak KAM solution m_ such that U4. < m_, m+ = U- in ^0 (IBj) Theorem 
5.12). The pair (u+,m_) is then called a weak KAM conjuguate pair. It is 
a remarkable fact that for all (x, t), (y, s) in M x T 

h{{x,t),{y,s)) =sup{u_(y,s) -u+(x,t)} 

where the supremum is taken over all weak KAM conjuguate pairs {u^, u_) 
(IE], Corollary 5.37). 

2.2. An estimate. To clear up the notation, we assume a(0) = by re- 
placing L with L — a(0) . Take e > 0. Let A^(e) € N* be the smallest integer 
such that 

Vn > N{e),y{x, r), (y, a) G M x T, /i„((x, r), (y, a)) > h{{x, r), {y, a)) - e. 

Let (m_, M+) be a weak KAM conjugate pair such that {u- — U-^-)^^{0) = Aq- 
Define A^ := (u_ — U4.)~^([2e, -|-cxd[). Let a, b be elements of M U ±00 and 
let 7 : [a, b] — > M be an absolutely continuous curve. Denote by Leb 
the normalized Lebesgue measure on M, by Int the integer part, and set 
/x^([a,6]) = Leb(7-i(A,)). Then 

Lemma 4. We have : 

\i^{t),^it),t)dt > u+(7(6),6) -n+(7(a),a) +eM^^^|^). 

Proof. Define inductively a sequence in M U itcx) by io '■= a and 

ti+i :=max{ti <t<b: t - U > N{e), ^l^{[a,b]) < N{e)} 

Set rii := Int(tj+i — ij) ; we have rii > A^(e). Note that Vi > 1, (7(tj), tj) € yl^ 
; this is the reason why we need a max in the above formula. Also, denoting 
n = max {i: ti < b}, we have 

„ = ,„t(M^) 

since ;U^([ti, tj+i]) = iV(e). 
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Now, we have 
f Lijit),iit),t)dt = Y. T''' L{j{t),^it),t)dt+ f Lijit),jit),t)dt 

n-1 

+U+{-f{b),b) -U+{j{tn),tn). 

Since rij > N{e), we have 

hrH{{7{ti+i),ti+i),{'j{ti),ti)) > h{{-f{ti+i),ti+i),{-f{ti),ti)) -e 

> u_(7(ti+i),tj+i) -u+{j{ti),ti) -e 
whence 

/ L(7(t),7(t),t)dt > ^[n_(7(ti+i),ti+i)-u+(7(t,),ti)-e] 

+U+(7(6),6) -U+{j{tn),tn) 
n-1 

= Y[u^{7{ti+i),ti+i) -u+{j{ti),ti) -e] 

i=l 

+n+(7(6),6) -n+(7(a)),a) 
and, because (7(tj+i), tj+i) G ^4^, 

L{j{t),^{t),t)dt > u+{j{b),b) - n+(7(a),a) +ne 

which proves the Lemma. D 

2.3. Consequence of the estimate. 

Lemma 5. There exists a C^ non-negative function W : M xT — > M which 
is positive outside Aq and zero inside Aq, such that a{L — W) = Oi{L) and 
Ao{L-W) = A^{L). 

Proof. First we point out that, denoting Xe the characteristic function of A^, 
Lemma m may be rewritten 

(1) 

b ^ .b 

L{j{t),^{t),t)dt > n+(7(6), b) - n+(7(a), a) + — - J Xehit),t)dt - e 
since for each i we have 

'^ Xe{l{t),t)dt = N{e) 

and 

fb 

Xe{l{t),t)dt<N{e). 
The map 

2-n 
X ■■= sup , . X2~" 
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is integrable by Lebesgue's Monotone Convergence Theorem. So, taking the 
supremum over n G N in Equation (^ we get 

b rb 

L{j{t),^{t),t)dt > u+{jib), b) - n+(7(a), a) + x{l{t),t)dt - 1. 

J a 

Now pick a C^ function W : M x"S — *■ M which is positive outside of ^O) 
and such that 

V(x,t) e M X T, < W{x,t) < xix,t). 

First let us verify that such a function exists. For every n in N we can 
find a C^ map Wn : M x T — > M with C^-norm < 1 and such that 

n— n— 1 

V(x,i) G M X T, < Wn{x,t) < ___X2-n(x,i). 
Now consider W := J2n>o ^"' then Vl^ is C^, non- negative, and 
y{x,t)£An+if]MxT\An,W{x,t) < Yl ^ 



N(2-'') 

k>n+l ^ ' 



2-n 
< 



iV(2-") 
< X{x,t) 

the latter inequality being true because {x,t) ^ A„. 

It remains to be seen that a{L — W) = a{L). 

First, note that since W is non- negative, for any real number c, a sub- 
solution of (HJc) for H + W \s also a subsolution of (HJc) for H so Q = 
a{H) <a{H + W). 

Conversely, let /i be an ergodic (L — VF)-minimizing measure and let 
7: M — > M be a curve such that (7,7,*) is a //-generic orbit. We have, for 
ah s, t in M : 

' {L(7(t),7(t),t)-PF(7(t),t)}dt> 



rb 

u+{j{b), b) - ^+(7(a), a) + / {x{l{t),t) - W{^{t),t)} dt - 1 



a 



> u+(7(&), b) - n+(7(a), a) - 1 
thus by Birkhoff 's Ergodic Theorem 

f{L - W)dfi > 0. 

This proves that = a{L) > a{L - W) so a{L) = a{L - W). 
Let us pause for a moment to prove 

Proposition 6. There exists a critical subsolution which is strict at every 
point of M xT^\Aq. 

Remark 7. The autonomous case of this Proposition /jFSn4j . Proposition 
6.1) is the first step of the proof of Theorem 1.3 of |,FS04) . The idea of the 
proof that follows is borrowed from |BBa) . 
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Proof. Take a weak KAM solution u for L — W, where W is given by Lemma 
El Recall that the Hamiltonian corresponding to L — W under Legendre 
transform ii H + W. At every point of differentiability of u we have 

uu uu 

— + H{x, —,t) + W{x, t) < ai-wiO) = aiiO) 



that is, 



du uu 

— + Hix, -g^,t)< aUO) - W{x, t) 



so u is a subsolution for L, strict outside of ^o- ^ 

Observe that, since we know from |CISj that any critical subsolution is 
actually a solution of (HJa (-?/)) in Aq, the latter Proposition implies the 
following characterization of the Aubry set : 

Proposition 8. A point {x,t) ^ M xT is in Aq if and only if no critical 
subsolution of (HJ) is strict at {x,t). 

Now let us come back to the proof of Lemma 13 We still have to find W 
such that Aq{L — W) = Ao{L). First note that since W is non-negative, 
and = a{H) < a{H + W), any critical subsolution of (HJ) for H + W is 
also a critical subsolution of (HJ) for H. Besides, W being positive outside 
^0) such a subsolution is strict (for H) outside ^o- By Proposition |HJ this 
implies Ao{L - W) D Ao{L). 

For the converse inclusion we may need to modify W. Assume there exists 
a Wi such that < W < Wi, all inequalities being strict outside ^O) and 
a{H + Wi) = a{H + W). This can be achieved by replacing W with W/2 
and taking W as Wi. Then a critical subsolution for H + Wi is a also a 
critical subsolution for H + W, and it is strict for H + W outside ^O; which 
proves Aq{L -W) d Aq{L). 

U 

3. SUBSOLUTIONS 
Now we extend to the time-periodic case Theorem 1.3 of |FS04j : 

Theorem 9. There exists a C^ critical subsolution which is strict at every 
point ofMxT^\Ao. 



At this point we assume the reader has Theorem 9.2 of |FSn4j before his 
eyes and explain how it applies. Take 

• N ■.= M xT^ 

• f := u given by Proposition El 

• A:= AoiL) = AoiL - W) 

• B := the domain of du ; B has full measure and du is defined in B 
and continuous in A 

• since we do not require the C^ subsolution to approximate the strict 
subsolution, we do not need to specify e 

• 

F:= {{x,p,t,T) eT{M xT^)\Ao: T + H{x,p,t) < aL{0) - W{x,t)} 
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0:= l{x,p,t,T) eT{M xT^)\Ao: T + H{x,p,t) < aiiO) - -W{x,t)\ . 

Then Theorem 9.2 of |FS04j yields a function g that is the required C^ 
critical subsolution, strict at every point of M x T^ \ Aq. D 

3.1. Closed measures. If we are going to extend Theorem |21 to time- 
periodic systems we have to integrate functions on T{M x T) with respect to 
measures that are only defined on TM x T. The crucial point in the proof of 
Mather's lemma is that invariant measures are supported on curves in TM 
of type (7(t), 7(t)). In the time-dependant setting we are considering curves 
in M X T of type {'~f{t),t) so their velocities are (7(t), t,7(t), 1). So the mea- 
sures on T{M X T) that we shall use are concentrated on the hypersurface 
{{x, t, V, 1) : (x, V, t) G TM x T} in T{M x T). This leads to the following 

Definition 10. A probability measure fx on TM x T is called closed if 

\\v\\ dfj.{x, v,t) < +00, 



iTMxT 

and for every smooth function f on M xT, we have 

df{x,t).{v,l)dfi{x,v,t) =0. 

TMxT 

Then Mather's lemma and its proof carry over without modification. 

Let us sketch briefly how the proof of Theorem 1.6 of |FSn4j applies to 
the time-periodic case. The first part of the proof consists of showing that a 
closed measure that realizes the minimum is supported inside Aq. To make 
it work in the time-periodic case it suffices to replace every occurence of 
H{x, dxu) by dtu + H(x, dxU, t). Then apply Proposition 10.3 of |FS04j with 
N = M xT instead of M, and you're done. 

4. Minimal Action 

4.1. Preliminaries. Since the a-function of L is convex, at every point its 
graph has a supporting hyperplane. We call face of a the intersection of 
the graph of a with one of its supporting hyperplane. By Fenchel (a.k.a. 
convex) duality it is equivalent to study the differentiability of /? or to study 
the faces of a. If c is a cohomology class, we call F^ the largest face of a 
containing c in its relative interior, and VectFc the underlying vector space 
of the affine space it generates in H^{M,'R.). We call Vc the underlying 
vector space of the affine space generated by pairs {c',a{c') — a{c)) where 
c' € Fc- Replacing, if necessary, L by L — u; where [to] = c, we only need 
consider the case when c = 0. Likewise, replacing L with L — a(0) we may 
assume a(0) = 0. 

Definition 11. Let Eq be the set of {c,t) e H^{M x T,M) = H^{M,M) x 
H^{T,M.) such that there exists a smooth closed one-form lo on M x T with 
[uj] = {c,t) and supp^u) riAo = $. Let Eq be the canonical projection of Eq 

to H\M,R). 
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Definition 12. Let Gq be the set of {c,t) e H^{M x T,IR) = H^{M,W) x 
i7^(T,M) such that there exists a continuous closed one-form u on M x T 
with [uj] = (c, r) and 

uj{x, t, v,t) =0 y{x, t) eAoC M xT, y{v, r) G T(^^^t)M x T. 

Let Gq be the canonical projection of Gq to H^ (M, M) . 

Now we can state the main result of this section 

Theorem 13. The following inclusions hold true : 

Eq C VectFQ C Go. 

In view of the above definitions we shall need to integrate one forms 
on M X T with respect to invariant measures. We denote by J codfi the 
expression 

/ ^ix,t)-ivA)dfJ-ix,v,t). 

Jtmxt 

The following lemma is useful. 

Lemma 14. If uj is a closed one form on M x T, with [lo] = (c, r) G 

//^(M, M) X i7-'^(T,IR), and n is an {L,c) -minimizing measure, then 

{L — uj)dfi = —a{c) — T. 

Proof. Consider a closed one-form lui on M such that [toi] = c. Denote 
f the constant one-form rdt on T. Then cji © f is a one-form on M x T, 
cohomologous to to. Let / be a smooth function on M x T such that (cJi, f) = 
u) + df . Then by Mather's lemma (invariant measures are closed) 

(L - u))dii = {L- {ui® f))dfi. 



On one hand J{L — LOi)d^ = —a{c) since /U is (L, c)-minimizing. On the 
other hand, since ^u is a probability measure, we have J fd^i = J rd^ = r. 
The lemma is proved. D 

4.2. Proof of Eq C VectFo. Pick c G Eq. Let r G iJ^(T,M) and uj a closed 
one-form on M x T^ be such that supp(u;) r\ Aq = ^ and [lS\ = {c,t). Since 
supp(a;) is compact there exists e > such that 

ii_(a;, t) — U-^-{x, t) > 2e V(x, t) G supp(aj). 

By a priori compacity there exists a compact subset K in TM x T^ such 
that for all 6 G [—1, 1], for all L + ^w-minimizing measure fi, the support of 
^ is contained in K. Let 6 be such that 

\/{x,v,t) G K,\Suj(^^^f){v,l)\ < J—. 

Let n be an ergodic (L -|- (5c<j)-minimizing measure and let 7: M — > M be a 
//-generic orbit. We have, for all s < t : 

5^(7,7,t)dt <(t-s)^<elnt(^^j+e 
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whence 

/ {L + 5uj){j,'y,t)dt > u+{j{t),t) - u+{j{s),s) - e 

thus by Birkhoff's Ergodic Theorem J{L + 5uj)dfi > 0. Now by Lemma 

m 

{L + 5u))d^ = —a{8c) — 5t so a{5c) < —St. 



/' 



Likewise, a{—5c) < 5t thus a{6c) + a{—6c) < 0. On the other hand by 
convexity of a the reverse inequahty is true : a{dc) + a{—6c) > so the 
inequahties a{5c) < —6t and a{—6c) < St are actually equalities. This 
means that a restricted to the line segment [—(5c, (5c], is affine with slope 
— T, which proves that — r = a{c) and Sc E Fq whence c € Vect-Fo. D 

4.3. Proof of VectFo C Gq. Pick c in the interior of Fq. Note that by 
Proposition 6 of |Mt03j we have Ac = Aq. Take co a smooth closed one- form 
on M such that [co] = c. Let uq (resp. ui) be a C^ subsolution for L (resp. 
L — oj). Then for all (x, v, t) G ^O; we have 

dui dL 

Observe that the Hamiltonian paired by Legendre transform with L — u) \s 
ix,p,t) I — > H{x,p + uJx,t) := H^{x,p,t). Thus 

V(x,t)G A H^ix,-^{x,t),t) = H{x,-^{x,t),t). 

On the other hand in ^o ^o ^-nd ui are solutions of the Hamilton-Jacobi 
equation : 

^(x,t) + F(x,^(x,t),t) = a(0) 
— {x,t)+H^{x,—{x,t),t) = a[c) 



whence 



^^""^ ""^^x, t) = a{c) - a(0) V(x, ?;, t) G A- 



9i 
Consider the closed one-form ti; on M x T defined by 

^{x,t){v,T) := u;x{v) + (a(0) - a{c))T. 

The cohomology class of a) is (c, a(0) — a{c)) and u) = (i(uo — ui) in ^o so 
replacing u) by the continuous one-form u;—(i(Mo — tti) we see that c £ Gq. D 
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